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Abstract 

Predictions about the future are contingent on future usage, but also on the quality of the 
models employed and the assessment of the current health state. These factors, amongst 
others, need to be considered to arrive at a prediction that is conducted through a rigorous 
method but where the confidence bounds are not prohibitively large. 
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Uncertainty in Prognostics and 
Health Monitoring 

• Uncertainty is unavoidable in PHM 

• Engineering system 

- Loading conditions and operating conditions are uncertain 

- Models used to study these systems are uncertain 

• Health Management System 

- Sensors -> errors due to bias and noise 

- Algorithms may not be accurate 

• Leads to uncertainty in both diagnosis and prognosis 

• Diagnosis -> characterizing events that have happened 

- Uncertainty in fault detection, isolation, and estimation 

- Nevertheless, we can live without measures of uncertainty because we are only trying 
to find out what has already happened! 

• Prognosis -> characterizing events that are going to happen 

- How can we ever be certain about the future? 



Uncertainty in Prognostics 

• Some of the existing literature claim to handle uncertainty in 
prognostics using particle filtering or other filtering approaches 

- Such a statement is incorrect 

- Filtering is only for state estimation, which may be considered a pre- 
cursor or first step to prognosis. 

- After state estimation, the goal in prognostics is to predict the future (no 
data) 

- Without data, the “correction step” of filtering will be absent, and 
therefore, it is not appropriate to call it “filtering” - we “filter” based on 
data! 

- In fact, the term “filtering for prognostics” is simply a misnomer 

- You simply take particles/samples and predict forward into future 

- Of course, if using Kalman filter, we have closed form expressions for 
future state distributions 

• Another challenge is that of uncertainty interpretation - this is 
closely tied to the type of prognostics method and the context of our 
application 

• A lot of existing literature seems to use “uncertainty management” 
for almost every task related to uncertainty and this is not quite 
correct. 
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Types of Uncertainties 



• Model uncertainties - Epistemic 

- Numerical errors 

- Unmodeled phenomenon 

- System model and Fault propagation model 

• Input uncertainties - Aleatoric 

- Initial state (damage) estimate 

- Manufacturing variability 

• Measurement uncertainties - Prejudicial 

- Sensor noise 

- Sensor coverage 

- Loss of information during preprocessing 

- Approximations and simplifications 


Systematic 
uncertainties due to 
things we could know in 
principle, but don’t in 
practice. 


Statistical uncertainties 
that may change every 
time the system is run. 


Unknown uncertainties 
due to the way data are 
collected or processed. 


• Operating environment uncertainties 

- Unforeseen future loads / environment 

- Variability in the usage history data 


J | 

Can be a mix of any of 
the above. 
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Trends and Thresholds Revisited 




Band of uncertainty 
around 

measurement points 


Many possible 
Models may “fit” the 
measurements 


Use statistics to 
extrapolate the 
uncertainty into the 
future 


Resulting pdf can 
be used to 
determine the 
probability of EOL 
occurring between 
two future time 
points 


Risk vs POF 
Time (ij 


Decision 

Point 
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Trends and Thresholds Revisited 


Failure Threshold (a FT ) 


Probability 
distribution of the 
trending parameter 
at a given time in 
the future 





Can be represented 
by a pdf describing 
the initial conditions 


pdf is then 
propagated forward 
in time 


Probability 
the parameter 
will be less than 
at the time 


Resulting pdf’s can 
be used to 
determine the 
probability that a 
parameter has 
reached a given 
value at a given 
point in the future 
TFT&r 


Time (t) 


Decision 

Point 
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Trends and Thresholds Revisited 




Can be represented 
by a pdf describing 
the initial conditions 


pdf is then 
propagated forward 
in time 


Taking a “horizontal 
slice” of the 
resulting surface at 
a FT yields the pdf of 
EOL at that failure 
threshold 


Time (t) 


Decision 

Point 
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Uncertainty-Related Activities in 
Prognostics 



• Uncertainty Representation and Interpretation 

- What method we choose to represent uncertainty? 

- Mostly, we have been using probability methods 

- Fuzzy logic, evidence theory, etc. are also available 

- Even for probabilistic methods, can we correctly interpret the uncertainty? 

• Uncertainty Quantification 

- Identify each source of uncertainty that affect prognostics 

- State estimation uncertainty, future loading uncertainty, model uncertainty, etc. 

- Quantify each source of uncertainty individually 

• Uncertainty Propagation 

- Quantify the combined effect on prognostics 

- Quantify uncertainty in future states and quantify uncertainty in RUL 

• Uncertainty Management 

- How to reduce the uncertainty in RUL? 

- How to translate the information regarding uncertainty to the decision-maker? 
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Uncertainty Interpretation 



• Probabilistic methods are used in PHM 

- Bayesian filtering approaches are used to estimate 
uncertainty in the states -> Particle, Kalman, 

Extended Kalman, Unscented Kalman ... 

- A lot of initial studies assumed Gaussian (normal) 
variables for different quantities but now we are slowly 
moving over to non-Gaussian variables too, 
particularly in non-linear systems 

- We are familiar with probabilistic theorems, probability 
density functions, cumulative distributions, etc. 

• But what do we mean by probability ?! 

- What do we mean by “The probability of a particular 
event is 0.4” ? 
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Approaches to Prognostics 


• Testing-based 

- Run multiple components/systems to failure 

- Collect several realizations of run-to-failure data 

- Use statistical tools for quantifying prognostics uncertainty 

- More suited to analyze reliability/prognostics of fleet of components/ 
systems since the data is collected across multiple components of the 
fleet 

- Practically feasible only to small components since the cost of failing 
large systems is very high 

• Condition-based 

- Focus is on one particular component or subsystem or system 

- Intra-fleet variability is not considered 

- At any time instant, the condition of the system is estimated (filtering) 
and RUL needs to be predicted 

- Applicable to ISHM, CBM 
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Why is the RUL prediction 
uncertain? 

• Either because 

- There is true variability across multiple specimens/components 

- We do know certain deterministic quantities exactly and we assign subjective 
uncertainties to them 

• Sources of Uncertainty 

- Present uncertainty: estimating present health state of the system 

- Future uncertainty: future operating and loading conditions 

- Prediction model uncertainty: model used to predict future state evolution 

• Model form, model parameters, process noise 

- Prediction method uncertainty: algorithm used to combine the different sources of 
uncertainty may not be perfect 

• Uncertainty quantification -> deals with quantifying the each of the 
above sources of uncertainty -> a separate challenge by itself 



How to compute the uncertainty in 
RUL? 

• For some reason, the uncertainty in RUL has been 
assumed to be Gaussian in many applications 



- In data-driven approaches, standard fitting techniques are 
used and there is some rational is assuming that the 
prediction is Gaussian 


- In model-based techniques, linear models are used along 
with Gaussian variables, and it is believed that this 
combination will lead to Gaussian RUL predictions 

- Well, both are wrong!! 


• In data-driven approaches, the prediction uncertainty 
is mainly reflective of the points (i.e., data) used to 
“train” or “fit” the data-driven technique. More the 
points used, lower the uncertainty. This is not reflective 
of the underlying uncertainty - be it the result of “true 
variability” or “subjectivity” 
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Model-Based Framework 




mm mm _ 

System 1 

Estimation 

“ Prognosis 

Inputs and Outputs 



1 . State Estimation 

Bayesian tracking 
e.g., Kalman filtering 


2. State Prediction 


Use State Space 
Model 


3. EOL Calculation 

Define EOL formally 
Calculate uncertainty 



Diagnosis 

Ddmayc ui ucic 


•ioration 


Usable? 


Biz^fcnted using states or 

Diagnosis s 
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No , 


i 

EOL 
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Parameters Input Process 

St 1 \ \ I N °' se 

Sta Moder e ( t)=f(t,X(t),0(t),U(t),V(t ) 


Output 


Sensor 

Noise 


Continuous monitoring: 

Measurements available until k ' 

prediction time t = t P I 0(t), Tly l ) 
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Uncertainty in Prognostics & RUL 


Failure threshold T EOL is linked to boundary in multi- 
dimensional damage space 

Beyond the boundary, the system does not conform to 
functional specifications (or operational risk is too great) 
Within the boundary, the system is still functioning 
properly 


From time t 0 to prediction time t P , system 
within specs 


Util lavtio 


EOL\tiP )=\nf [tE E : t> tiP A TlEOL (x(t),0($)=l} 
RUL(tiP )= EOL (tiP )-tiP 



EOL/RUL Prediction: Sources of Uncertainty 

• State at t P cannot be precisely known 

• Future loading conditions and operating conditions 
not precisely known 

• Even if state is known, future loading is known -> we 
may not have the accurate “mechanism” to predict 
future state -> model error 


Future behavior is uncertain 

System takes some path out of many 
possible paths until EOL 

At any instant t P , state evolution becomes 
a random process 

EOL and RUL are random variables 
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Computing RUL 


Future Loading 




u(tP), u(tip+ 1), u( 


v(tP), v{tlP+l ), l< 

tlP+ 2), u{tlP+ 3) ... 


tlP+ 2), v(tlP+ 3) 

u(FOL) 


... v(EOL) 



Future process noise 


Future parameters 
0(tP), OitlP 
+1), 0(tlP 
+2), 0{tlP 
+3) ... 0 
(EOL) 


EOL = / 
RUL -t-tp 


RUL=G{x(tP), u(tiP ),u(tiP +1), u(tiP+2 )... u(EOL), 0(tlP ),0(tiP +l),0(tlP+2 ) ... 
), v( tiP lv(tlP +l).v(tlP+2)... 
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Compute the uncertainty in RUL 



RUL=G{x(tP), u(tlP ),u(tlP +1), u(tlP+2 )... u( 
tlP +RUL), 0(tlP),0(tlP +l),0(tlP+2 ) ... 0(tlP 
+R ///.). v(tlP),v(tlP + 1),v(tlP+2 )... iXtlP 


^\=G(JQ=G(Xll M2 ,XB ...Xl\ ] 


Xh \ ~ flXU % li) 


Computing RUL unce 


n + cim 


:y in 


basically propagating the uncertainty in ^through “G 


- Closed form expressions not available even for certain simply scenarios 

• Given the full probability distribution of each X t -> Compute distribution of RUL 

• Several methods available for such uncertainty propagation 

- Sampling techniques 

- Analytical techniques 

- Mixed approaches 

• Points to Remember 

- Methodology needs to be feasible for online implementation 

- Accurately capture the distribution shape (Even multi-modal RUL distributions) 

- Deterministic methods are preferred -> leads to the next presentation 

- Capturing central behavior is easy -> also capture probability tails 

- Easily calculate some sort of “bounds” on RUL without much computational effort 
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Simple illustrative example 
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Model-based prognostics (1/2) 




x(t) = f(x(t),u(t))+w(t) 
y(t) = h(x(t)),u(t)) + v(k) 

R(t p ) = tEOL ~ t p 


{y(t 0 ),...,y(t p )} 


Kalman 

X(tp) 

Health State 

Filter 


Forecasting 


f f 

i i 

V 2 {aj} 


{x(tp-j-i), . . . j ®(tp-)-Jv)} 


RUL 

Computation 


T 

RUL(t p ) 


State vector includes 
dynamics of the 
degradation process 

It might include nominal 
operation dynamics 

EOL defined at time in 
which performance 
variable cross failure 
threshold 

Failure threshold could 
be crisp or also a 
random variable 
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RUL as a random process 

• Random process: Family of random 
variables indexed in time 



- RUL estimates through time can be regarded 
as a random process 

- R(t): RUL estimation at time t, is a random 
variable 

- The probability density function (PDF) is 
unknown 


- Prognostics algorithm attempts to estimate 
parameters of R(t) or to approximate the 
density altogether 
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Implications on health state 
estimation (1/2) 

• Measurement and model noise variances become 
important 



- They need to be representative of the real process as for the 
uncertainty represented on the state estimate to be accurate 


• Variance of sensor error can be computed if sensor is 
available for experimentation 


• Variance of model error could be computed from run-to- 
failure data and degradation model 

- This is possible for simple cases but a challenge for large 
systems 


x(t) = f(x(t),u(t )) + w(t) 
y(t ) = h(x(t)),u(t)) + v{k) 
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Uncertainty propagation (1/2) 



• The forecast are computed using the state 
equation only (one step ahead) 

x p ( 1 ) = Axp + Bu p + w p 


. x p (l) ~ 


• I th step ahead^ forecasting: 

IM = A 1 Xp + Bu p + A 1 ai 2 = (A 2 ) l Pk + A 2 ) l (j w 2 + c v 


/-i 


i=0 


i=l 





RUL(t p ) 
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Discussion(1/2) 



• From analytical results, variance will be 
higher after forecasting process as expected 

- The more forecasting steps, the larger the 
variability 

- This is consistent with the notion that the 
estimation should become more accurate as the 
component gets closer to EOL 


C n 2 = ( A 2 ) l p k + ^2(A 2 Ya w 2 + a w 2 
1=1 


• There is no evidence to support RUL being 
Normal so this should be avoided 
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Discussion (2/2) 



• Non-linear random variable transformation involved in 
final step 


- Computational method could solve this 

- Exploring if it can be solved analytically 


- It is evident that it is incorrect to assume that RUL variable is 
the same as the error covariance in the state estimation or the 
variance after the forecast 


• This assessment was conducted over a scalar case. 

- Additional considerations should be taken on the vector case 
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Example on a Rover application 
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Case Study ^ 

Power System of a Planetary Rover 


. Battery prognostics for a planetary 
rover, simulation-based results 

. Event E is end-of-discharge, 
defined as the time when the 
battery voltage reaches 2.5 V 

. Rover has set of waypoints that it 
is traversing 


. Two different scenario types: 

- Rover commanded to go the same forward speed between waypoints 
(analogous to constant loading) 

- Rover commanded to go different speeds between waypoints 
(analogous to variable loading) 
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Uncertainty Representation 

• Knowing present state at prediction-time t P 

- Provided by the state estimation algorithm 

- Particle filter -> particles + weights 

- Kalman filter -> statistics of Gaussian (normal) distribution 

- Use such information to calculate the PDF of the state variable 

• The other three quantities are time-trajectories 

- Future Loading 

- Future parameter values 

- Future process noise values 

• At each time instant, they follow a probability distribution 

- Quantifying this, by itself, is a separate topic of research 

- Assume that this is available for this research work 

- Focus on quantifying their combined effect on prediction uncertainty 

• Concept: stochastic process 



Representation of 
Stochastic Processes 



• Stochastic process 

- At each time instant, the quantity follows a probability distribution 

- A stochastic process can be expressed as a combination of deterministic 
time-dependent function and random time-independent variables 

- For example, the concept of Karhunen-Loeve expansion 

- Following a similar, simpler approach in this work 


• Stochastic process -> “deterministic” time-dependent function + time- 
invariant random variables 


- Since these random variables can reproduce the stochastic process, they 
are referred to as “surrogate variables” 


- For e.g., choose surrogate variables 


- Then, the trajectory can be defined ^ 

- Easier to define statistics for surrogate variables 

- For example, if future input is constant, it is define (k) 
variable which defines what the input value is for an iuiuic 


= [«...] 

= A* + sin k 

III 1 1C £>IC|JS> 
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Prognostics Architecture 

• Estimator -> estimates of states 

• This is an input to the prediction algorithm, along with the statistics 
of the surrogate variables, that correspond to 

- Future loading 

- Future parameter values 

- Future process noise values 



Prognostics 


u(*) 


y(*) 


hstinuition 

p(x(Ar).0(*)|y(Ar n :*/»)) 

Prediction 


pikE(k P )\y(k 0 :k P ))^ 











? — TTT 


/>(A*) />(A U ) />(A,.) 


— Given the probability distributions of the present state values (indicate 
present health) and of the surrogate variables 
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Compute prediction uncertainty 


I 


• Given the full probability distribution of each X t -> Compute distribution of RUL 

• Choice of methods available for such uncertainty propagation driven by goals 

Develop an efficient, integrated health monitoring system 

- Verification, Validation, and Certification of Systems 

General consensus (based on standards) -> “deterministic algorithms” to be used in ISHM 

- Whether is it possible construct “some” bounds on RUL! 

• Standards for Aviation 

Do not discuss much about uncertainty while prognostics uncertainty is unavoidable 

- We want the standards to evolve to consider non-deterministic approaches but will take time 
Uncertainty quantification methods to be V&V-ed and certified “deterministic” approaches 

• Approaches presently pursued 

Monte Carlo Sampling (non-deterministic) 

Unscented transform sampling (deterministic) 

Inverse First-order Reliability Method (or) Inverse-FORM (deterministic) 


RUL=P{x(tP % u(tlP ),u(tlP +1 ), u(tlP +2 )... U( 
tlP+RUL), 0(tlP),0(tlP +1 ),0(tlP+2 ) ... 6 (tlP 
+RUL), v(tlP),v(tlP + 1),v(tlP+2)... iXtlP 


P(X)=G(Xll ,X12 ,X13 ...XI 


Xh \ ~ flXli % li) 


Computing RUL uncertainty in basically propagating the uncertainty in A - through “P" 

Closed form expressions not available even for simple scenarios 
- The combination of state space models and the threshold function automatically renders “P” non-linear 



Each method focuses on one aspect 
of the prediction 

• Monte Carlo sampling 

- Attempt to directly generate samples from the distribution of k E we want to 
obtain -> histogram, kernel density, etc. to get PDF 

• Unscented transform sampling 

- Commonly used in Kalman filtering for state estimation 

- Sampling based on predetermined probability levels -> sigma points 

- Estimate mean and variance with reasonable accuracy and hence 
suitable for state estimation in Kalman filtering 

- Also been used for prediction, but cannot get tail probabilities accurately 

• Inverse FORM 

- Originally developed by structural engineers to calculate the probability of 
failure of structural systems 

- Focuses on estimating the inverse CDF of RUL 

- Calculate “k E given “rf , i.e. for a given probability level 

- Estimate the entire CDF of tt k E ” by repeating for multiple probability levels 

Prognostics Center of Excellence 
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Case Study: Battery Model 




Lithium-ion battery model with electrical 
circuit equivalent 
- C b holds battery charge 


SO 


= 1 — qimax — qib /Cim ax 


R C p/C CP pair for concentration 
polarization (major nonlinear process 
producing steep discharge curve 
near end of discharge (EOD) 


RiCP =RICP J-0 +RICP11 exp[RlCPtt (1-SOC}] 


Circuit elements represent equilibrium 
voltage and voltage drops due to battery 
internal resistances and electrochemical 
processes 


h 

C b 


' l CP 


C C p 


Battery Equivalent Circuit 
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Future Input Characterization 


• Consider only uncertainty in state and future inputs 

• While the state uncertainty is provided by the estimator (Unscented 
Kalman filtering is used in this work), future input trajectories need to be 
defined 

• Surrogate variables corresponding to the future input trajectory need to 
be defined 

• Future input to battery depends on how rover will be used - rover turns 
to next waypoint while maintaining desired forward speed. Turns take 
more power than going straight, and increase distance traveled 
between two waypoints over straight-line distance 

• System-level approach accounts for all these details by simulating the 
entire rover instead of just the battery - most accurate but requires most 
computation 

• Limit to the rover battery in this work without full system simulation 
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Future Input Characterization 
(cont.) 

. Approach 1 

. Assume that distribution of future inputs is same as 
past inputs 

. Maintain a window of past inputs in which to compute 
these statistics 

. Vary the window length 

. Approach 2 

. Can incorporate some system-level knowledge while 
still having predictions local only to the battery 

. Compute power draw between waypoints for the 
known speed that the rover will go between them 

. Estimate future input trajectory based on current 
rover location and remaining waypoints 

• Improved future loading characterization 
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Quantifying Prediction Uncertainty ^ 

Results: Constant Loading 

,soo# j 



, |n - ••naa; ii t 
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— 

10000 j 
I- 

. Plots show prediction results using Monte 
Carlo sampling for the constant loading 
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scenario 
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1 
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A 

better represented and bounds get larger 
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. UT and Inverse FORM results are virtually 

identical 


Prognostics Center of Excellence 


20 


4/18/14 


Quantifying Prediction Uncertainty 
Results: Variable Loading 



. For variable loading scenario 

. Using the window approach 
(assuming future inputs look 
like past inputs) 

. Produces unstable predictions 

. Because the assumption is 
violated -> future inputs do not 
look like past inputs 
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Quantifying Prediction Uncertainty ^ 
Results: Variable Loading 

. Using improved method of 
future input characterization 

10000 


AfcJ 

. For each waypoint segment, 
surrogate variables are 
power draw and distance 
traveled 
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Conclusion and Recommendation 
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Implications on decision-making ^ 

(1/2) W 

• Properly capturing uncertainty is very important 

in prognostics 


- Decisions based on prognostics information might 
involve high risk 
• Contingency management 


• Decision-making process in the application also 
guides how RUL is modeled and how uncertainty 
management is done 

- This is typically not done now but it is important to be 
considered 

• Control reconfiguration decision differ from inventory 
management decisions 
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Implications on decision-making 

(2/2) 

• Decision-making capabilities differ in terms 
of handling uncertainty on RUL information 



- Optimization on the decision process 

• Ability to deal with RUL as a random variable 

• Assume RUL as Normal or other parametrized 
distribution 


• Ability to deal with non-parametric estimate 
information 


• Ability to deal with a priori information about the 
quality of the estimation process 
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Recommendations 



• Caution on uncertainty reduction by algorithm tuning 

- Empirical RUL PDF variability vs. Point estimates 
variability 

• Think about how the RUL estimation will be validated 

- Will help understand if uncertainty is properly taken into 
account 


• Think about the post-prognostics decision making 
process 

- Can the system reason about empirical PDF or about non- 
normal random variables? 


• Uncertainty management term is too ambiguous in the 
literature. Do not consider this a solved problem, it is 
easy to be misled, be inquisitive in establishing 
causality and validity of RUL uncertainty 
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